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' Abstract 

This paper studies an incentive structure for cooperation and its stability in peer-assisted services when there exist multiple 
content providers, using a coalition game theoretic approach. We first consider a generalized coalition structure consisting of 
multiple providers with many assisting peers, where peers assist providers to reduce the operational cost in content distribution. 
■ To distribute the profit from cost reduction to players (i.e., providers and peers), we then establish a generalized formula for 

individual payoffs when a "Shapley-like" payoff mechanism is adopted. We show that the grand coalition is unstable, even when 
£Nj | the operational cost functions are concave, which is in sharp contrast to the recently studied case of a single provider where the 

grand coalition is stable. We also show that irrespective of stability of the grand coalition, there always exist coalition structures 
which are not convergent to the grand coalition. Our results give us an important insight that a provider does not tend to cooperate 
with other providers in peer-assisted services, and be separated from them. To further study the case of the separated providers, 
| three examples are presented; (i) underpaid peers, (ii) service monopoly, and (Hi) oscillatory coalition structure. Our study opens 

. , many new questions such as realistic and efficient incentive structures and the tradeoffs between fairness and individual providers' 

competition in peer-assisted services. 

! I. Introduction 

The Internet is becoming more content-oriented, and the need of cost-effective and scalable distribution of contents has 
' become the central role of the Internet. Uncoordinated peer-to-peer (P2P) systems, e.g., BitTorrent, has been successful in 
£f~) , distributing contents, but the rights of the content owners are not protected well, and most of the P2P contents are in fact 
£N| ' illegal. In its response, a new type of service, called peer-assisted services, has received significant attentions these days. In 
, peer-assisted services, users commit a part of their resources to assist content providers in content distribution with objective 
of enjoying both scalability/efficiency in P2P systems and controllability in client-server systems. Examples of peer-assisted 
services include nano data center |Q and IPTV (2), where high potential of operational cost reduction was observed. For 
instance, there are now 1.8 million IPTV subscribers in South Korea, and the financial sectors forecast that by 2014 the IPTV 
subscribers is expected to be 106 million, see, e.g., Q. However, it is clear that most users will not just "donate" their resources 
to content providers. Thus, the key factor to the success of peer-assisted services is how to (economically) incentivize users 
to commit their valuable resources and participate in the service. 

One of nice mathematical tools to study incentive-compatibility of peer-assisted services is the coalition game theory which 
covers how payoffs should be distributed and whether such a payoff scheme can be executed by rational individuals or not. In 
peer-assisted services, the "symbiosis" between providers and peers are sustained when ( i) the offered payoff scheme guarantees 
fair assessment of players' contribution under a provider-peer coalition and (ii) each individual has no incentive to exit from 
the coalition. In the coalition game theory, the notions of Shapley value and the core have been popularly applied to address 
( i) and ( ii), respectively, when the entire players cooperate, referred to as the grand coalition. A recent paper by Misra et al. 
|0) demonstrates that the Shapley value approach is a promising payoff mechanism to provide right incentives for cooperation 
in a single-provider peer-assisted service. 

However, in practice, the Internet consists of multiple content providers, even if only giant providers are counted. The 
focus of our paper is to study the cooperation incentives for multiple providers. In the multi-provider case, the model clearly 
becomes more complex, thus even classical analysis adopted in the single-provider case becomes much more challenging, and 
moreover the results and their implications may experience drastic changes. To motivate further, see an example in Fig. Q] 
with two providers (Google TV and iTunes) and consider two cases of cooperation: (i) separated, where there exists a fixed 
partition of peers for each provider, and (ii) coalescent, where each peer is possible to assist any provider. In the separated 
case, a candidate payoff scheme is based on the Shapley value in each separated coalition. Similarly, in the coalescent case, the 
Shapley value is also a candidate payoff scheme after the worth function of the grand coalition N (the player set) is defined 
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Fig. 1. Coalition Structures for a Dual-Provider Network. 

appropriately. A reasonable definition of the worth function^ can be the total cost reduction, maximized over all combinations 
of peer partitions to each provided Then, it is not hard to see that the cost reduction for the coalescent case exceeds that 
for the separated case, unless the two partitions are equivalent in both cases. This implies that at least one individual in the 
separated case is underpaid than in the coalescent case under the Shapley-value based payoff mechanism. Thus, providers and 
users are recommended to form the grand coalition and be paid off based on the Shapley value, i.e., the due desert. 

However, it is still questionable whether peers will stay in the grand coalition and thus the consequent Shapley-value based 
payoff mechanism is desirable in the multi-provider setting. In this paper, we anatomize incentive structures in peer-assisted 
services with multiple content providers and focus on stability issues from two different angles: stability at equilibrium of 
Shapley value and convergence to the equilibrium. 

Our main contributions are summarized as follows: 

1) We first provide a closed-form formula of the Shapley value for a general case of multiple providers and peers. To that end, 
we define a worth function to be the maximum total cost reduction over all possible peer partitions to each provider. Due to 
the intractability of analytical computation of the Shapley value, we take a fluid-limit approximation that assumes a large 
number of peers and re-scales the system with the number of peers. This is a non-trivial generalization of the Shapley value 
for the single-provider case in J4). In fact, our formula in Theorem[T]establishes the general Shapley value for distinguished 
multiple atomic players and infinitesimal players in the context of the Aumann-Shapley (A-S) prices J5] in coalition game 
theory. 

2) We prove in Theorem |2] that the Shapley value for the multiple-provider case is not in the core under mild conditions, 
e.g., each provider's cost function is concave. This is in stark contrast to the single-provider case where the concave cost 
function stabilizes the equilibrium. 

3) We study, for the first time, the endogenous formation of coalitions in peer-assisted services by introducing the stability 
notion defined by the seminal work of Hart and Kurz (5). We show that, if we adopt a Shapley-like payoff mechanism, 
called Aumann-Dreze value, irrespective of stability of the grand coalition, there always exist initial states which are not 
convergent to the grand coalition. An interesting fact from this part of study is that peers and providers have opposite 
cooperative preferences, i.e., peers prefer to cooperate with more providers, whereas providers prefer to be separated from 
other providers. 

In short, the Shapley payoff regime cannot incentivize rational players to form the grand coalition, implying that fair profit- 
sharing and opportunism of players cannot stand together. If the grand coalition is broken up, the Shapley payoff scheme 
cannot be executed because the total profit of a coalition differs from the sum of Shapley payoffs in the coalition. Only payoff 
mechanisms for general coalition structure may be used. In conjunction with this point, we present three examples for non- 
cooperation among providers who adopt the Shapley-like payoff scheme: (i) the peers are underpaid than their Shapley payoffs, 
f ii) a provider with more "advantageous" cost function monopolizes all peers, and ( Hi) Shapley value for each coalition gives 
rise to an oscillatory behavior of coalition structures. These examples suggest that the system with the separated providers may 
be even unstable as well as unfairness in a peer-assisted service market. 

The rest of the paper is organized as follows. In Section [II] we define Shapley and Aumann-Dreze values with minimal 



'We establish in Section UlI-AI that this definition is derived directly from an essential property of coalition. 

2 The notion of peer partitions implicitly assumes that a peer assists only one provider. However, our model is not restricted in the sense that we will study 
the regime of a large number of peers for mathematical tractability, in which case a peer assisting two providers can be regarded as two distinct peers assisting 
distinct providers. 



3 



formalism. After formulating the fluid Aumann-Dreze formula for multiple providers, we establish results on the stability- 
related concepts in Section [IV] to substantiate that it is very unlikely that the grand coalition occurs. Then we point out main 
drawbacks of Aumann-Dreze value in Section [V] and conclude this paper. 

II. Preliminaries 

Since this paper investigates a multi-provider case, where a peer can choose any provider to assist, we start this section by 
defining a coalition game with a peer partition {i.e., a coalition structure) and introducing the payoff mechanism thereof. 

A. Game with Coalition Structure 

A game with coalition structure is a triple (JV, v, V) where N is a player set and v : 2 N — > K (2^ is the set of all subsets of 
N) is a worth function, v{%) = 0. v(K) is called the worth of a coalition K C N. V is called a coalition structure for (TV, v); 
it is a partition of N where C(i) G V denotes the coalition containing player i. For your reference, a coalition structure V 
can be regarded as a set of disjoint coalitions. The grand coalition is the partition V = {N}. For instanc^E a partition of 
N = {1, 2, 3, 4, 5} is V = {{1, 2}, {3, 4, 5}}, C(4) = {3, 4, 5}, and the grand coalition is V = {{1, 2, 3, 4, 5}}. V{N) is the 
set of all partitions of N. For notational simplicity, a game without coalition structure (N,v, {N}) is denoted by (N,v). A 
value of player i is an operator (j>i(N, v, V) that assigns a payoff to player i. We define 4>k = J2ieK & f° r a ^ K C N. 

To conduct the equilibrium analysis of coalition games, the notion of core has been extensively used to study the stability 
of grand coalition V = {N}: 

Definition 1 (Core) The core is defined by {(f>{N,v) \ J2 1& n^( N i v ) = V ( N ) and J2 ie K M N i v ) > v{K),VK C N}. 
If a payoff vector <f>(N, v) lies in the core, no player in N has an incentive to split off to form another coalition K because 
the worth of the coalition K, v(K), is no more than the payoff sum Y^ieK &C^> v )- Note that the definition of the core 
hypothesizes that the grand coalition is already formed ex-ante. We can see the core as an analog of Nash equilibrium from 
noncooperative games. Precisely speaking, it should be viewed as an analog of strong Nash equilibrium where no arbitrary 
coalition of players can create worth which is larger than what they receive in the grand coalition. If a payoff vector (f>(N, v) 
lies in the core, then the grand coalition is stable with respect to any collusion to break the grand coalition. 

B. Shapley Value and Aumann-Dreze Value 

On the premise that the player set is not partitioned, i.e., V = {N}, the Shapley value, denoted by ip (not (j)), is popularly 
used as a fair distribution of the grand coalition's worth to individual players, defined by: 

<Pi(N, v) = Escn\ {i} M^ZM^ ( V (S U «) - v(S)) . (1) 

Shapley J7| gives the following interpretation: "(i) Starting with a single member, the coalition adds one player at a time 
until everybody has been admitted, (ii) The order in which players are to join is determined by chance, with all arrangements 
equally probable. (Hi) Each player, on his admission, demands and is promised the amount which his adherence contributes to 
the value of the coalition." The Shapley value quantifies the above that is axiomatized (see Section III-Cb and has been treated 
as a worth distribution scheme. The beauty of the Shapley value lies in that the payoff "summarizes" in one number all the 
possibilities of each player's contribution in every coalition structure. 

Given a coalition structure V ^ {N}, one can obtain the Aumann-Dreze value (A-D value) |[8[ of player i, also denoted 
by tp, by taking C(i), which is the coalition containing player i, to be the player set and by computing the Shapley value 
of player i of the reduced game (C(i), v). It is easy to see that the A-D value can be construed as a direct extension of the 
Shapley value to a game with coalition structure. Note that both Shapley value and A-D value are denoted by cp because the 
only difference is the underlying coalition structure P. 

C. Axiomatic Characterizations of Values 

We provide here the original version Q of the axiomatic characterization of the Shapley value. 
Axiom 1 (Coalition Efficiency, CE) For all C £V, J2 jeC </>j(/V, u, 7?) = v(C). 

Axiom 2 (Coalition Restricted Symmetry, CS) If j G C(i) and v{K U {i}) = v{K U {j}) for all K C N \ {i,j}, then 
MN,v,T>) = <j>j(N,v,V). 

Axiom 3 (Additivity, ADD) <f>i(N, v + v', V) = c/>i(N, v, V) + c/>i(N, v', V) for all coalition functions v, v' and i e N. 
Axiom 4 (Null Player, NP) If v(K U {i}) = v(K) for all K C N, then & (AT, v, V) = 0. 

Recall that the basic premise of the Shapley value is that the player set is not partitioned, i.e., V — {A^}. Also, the Shapley 
value, defined in (Q~|), is uniquely characterized by CE, CS, ADD and NP for V = {N} Q. The A-D value is also uniquely 



3 A player i is an element of a coalition C = C(i), which is in turn an element of a partition V . V is an element of V(N) while a subset of 2 
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characterized by CE, CS, ADD and NP (Axioms [TJUi, but in this case for arbitrary coalition structure V (8). In the literature, 
e-g-, H), IfTUl , the A-D value has been used to analyze the static games where a coalition structure is exogenously given. 
Definition 2 (Coalition Independent, CI) If i G C C TV, C G V and C G V', then (f>i(N, v, V) = 4>i{N, v, V). 

From the definition of the A-D value, the payoff of player i in coalition C(i) is affected neither by the player set TV nor 
by coalitions C G V, C ^ C(i). Note that only C(i) contains the player i. Thus, it is easy to prove that the A-D value is 
coalition independent. From CI of the A-D value, in order to decide the payoffs of a game with general coalition structure 
V, it suffices to decide the payoffs of players within each coalition, say C G V, without considering other coalitions C G V, 
C 7^ C(i). In other words, once we decide the payoffs of a coalition C G V, the payoffs remains unchanged even though other 
coalitions, C G V, C ^ C, vary. Thus, for any given coalition structure V, any coalition C G V is just two-fold in terms of 
the number of providers in C: (i) one provider or (ii) two or more providers, as depicted in Fig. [T] 

The notion of CI also enables us to define the stability of a game with coalition structure in the following simplistic way: 
Definition 3 (Stable Coalition Structure 0) We say that a coalition structure V' blocks V, where V, V G V(N), with 
respect to <fi if and only if there exists some C G V such that <fii(N, v, {C, ■••})> 4>i(N, v, V) for all i G C. In this case, we 
also say that C blocks V. If there does not exist any V' which blocks V , V is called stable. 

Due to CI of the A-D value, all stability notions defined by the seminal work of Hart and Kurz Q coincide with the above 
simplistic definition, as discussed by Tutic ifTTI . Definition [3] can be intuitively interpreted that, if there exists any subset of 
players C who improve their payoffs away from the current coalition structure, they will form a new coalition C. In other 
words, if a coalition structure V has any blocking coalition C, some rational players will break V to increase their payoffs. 
The basic premise here is that players are not clairvoyant, i.e., they are interested only in improving their instant payoffs. If 
a payoff vector lies in the core, the grand coalition is stable in the sense of Definition [3] but the converse is not necessarily 
true (see Fig. 

III. Coalition Game in Peer-Assisted Services 

In this section, we first define a coalition game in a peer-assisted service with multiple content providers by classifying the 
types of coalition structures as separated, where a coalition includes only one provider, and coalescent, where a coalition is 
allowed to include more than one providers (see Fig. Q]). To define the coalition game, we will define a worth function of an 
arbitrary coalition S C TV for such two cases. 

A. Worth Function in Peer-Assisted Services 

Assume that players TV are divided into two sets, the set of content providers Z := {pi, ■ ■ ■ ,p$}, and the set of peers 
H := {rii, ■ ■ ■ ,n v }, i.e., TV = Z U H. We also assume that the peers are homogeneous, e.g., the same computing powers, 
disk cache sizes, and upload bandwidths. Later, we discuss that our results can be readily extended to nonhomogeneous peers. 
The set of peers assisting providers is denoted by H := {m, • • • , n x .^} where x = \H\/rj, i.e., the fraction of assisting peers. 
We define the worth of a coalition S to be the amount of cost reduction due to cooperative distribution of the contents by the 
players in S in both separated and coalescent cases. 

Separated case: Denote by Q,^(x(S)) the operational cost of a provider p when the coalition S consists of provider p and 
x(S)-rj assisting peers. Since the operational cost cannot be negative, we assume fl^(x(S)) > 0. Note that from the homogeneity 
assumption of peers, the cost function depends only on the fraction of assisting peers. Then, we define the worth function 
v(S) for the coalition S as: 

v(S) := W>(0) - W>(x(S)) (2) 

where fi^(0) corresponds to the cost when there are no assisting peers. For notational simplicity, in what follows, x(S) is 
denoted by x from now on. 

Coalescent case : In contrast to the separated case, where a coalition includes a single provider, the worth for the coalescent 
case is not clear yet, since depending on which peers assist which providers the amount of cost reduction may differ. One of 
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reasonable definitions would be the maximum worth out of all peer partitions, i.e., the worth for the coalescent case is defined 
by: 

v(S) =max|x; Ce pw(C) V G V(S) such that \Z n C\ = 1, VC e . (3) 

The definition above implies that we v/ew a coalition containing more than one provider as the most productive coalition whose 
worth is maximized by choosing the optimal partition V* among all possible partitions of S. Note that © is consistent with 
the definition © for \Z n S\ < 1, i.e., v(S") = for \Z D S\ < 1. 

Four remarks are in order. First, as opposed to J4) where v({p}) = t]R — OJj(O) (R is the subscription fee paid by any peer), 
we simply assume that ii{{p}) = 0. Note that, as discussed in (lQl Chapter 2.2.1], it is no loss of generality to assume that, 
initially, each provider has earned no money. In our context, this means that it does not matter how much fraction of peers is 
subscribing to each provider because each peer has already paid the subscription fee to providers ex-ante. 

Second, it is also important to note that we cannot always assume that 02 (x) is monotonically decreasing because providers 
have to pay the electricity expense of the computers and the maintenance cost of the hard disks of assisting peers. For example, 
a recent study |[T2l found that Annualized Failure Rate (AFR) of hard disk drives is over 8.6% for three-year old ones. We 
discuss in Appendix lAl that, if we consider a more intelligent coalition, the cost function 01? (x) is always non-increasing. 
However, we assume the following to simplify the exposition: 
Assumption 1 O^(x) is non-increasing in x for all p e Z. 

Third, the worth function in peer-assisted services can reflect the diversity of peers. It is not difficult to extend our result to 
the case where peers belong to distinct classes. For example, peers may be distinguished by different upload bandwidths and 
different hard disk cache sizes. A point at issue for the multiple provider case is whether peers who are not subscribing to 
the content of a provider may be allowed to assist the provider or not. On the assumption that the content is ciphered and not 
decipherable by the peers who do not know its password which is given only to the subscribers, providers will allow those 
peers to assist the content distribution. Otherwise, we can easily reflect this issue by dividing the peers into a number of classes 
where each class is a set of peers subscribing to a certain content. 

Lastly, it should be pointed out that the worth function in OJ is rigorously selected in order to satisfy a basic property: 
Definition 4 (Superadditivity) A worth function v is superadditive if (S,T C N and 5 n T = 0) => v(Sl)T) > v(S)+v(T). 

Suppose we have a superadditive worth function v'. We require v'(S) = v(S) if S includes one provider. It follows 
from the definition of v in (0 that v'(-) is no greater than v(-), i.e., v(-) > v'(-) because v is the total cost reduction that 
is maximized over all possible peer partitions to each provider. In the meantime, since v' is superadditive, it must satisfy 
v'(S U T) > v'(S) + v'(T) for all disjoint S, T C N, implying that v'(-) > v(-). This completes the proof of the following 
lemma. 

Lemma 1 When the worth is given by (f2]i, there exists a superadditive worth function, uniquely given by ||3). 

Superadditivity is one of the most elementary properties, which ensures that the core is nonempty by appealing to Bondareva- 
Shapley Theorem ifTUl Theorem 3.1.4]. In light of this lemma, we can clearly restate that our objective in this paper is to analyze 
the incentive structure of peer-assisted services when the worth of coalition is superadditive. This objective then necessarily 
implies the form of worth function in 0. 



B. Fluid Aumann-Dreze Value for Multiple-Provider Coalitions 

So far we have defined the worth of coalitions. Now let us distribute the worth to the players for a given coalition structure 
V . Recall that the payoffs of players in a coalition are independent from other coalitions by the definition of A-D payoff. Pick 
a coalition C without loss of generality, and denote the set of providers in C by Z C Z. With slight notational abuse, the 
set of peers assisting Z is denoted by H. Once we find the A-D payoff for a coalition consisting of arbitrary provider set 
Z C Z and assisting peer set H C H, the payoffs for the separated and coalescent cases in Fig.Q]follow from the substitutions 
Z = Z and Z = {p}, respectively. In light of our discussion in Section Hl-BI it is more reasonable to call a Shapley-like payoff 
mechanism A-D payoff and 'Shapley payoff respectively for the partitioned and non-partitioned games (N, v, {Z U H, - ■ ■ }) 
and {N,v,{ZUH}$ 

Fluid Limit : We adopt the limit axioms for a large population of users to overcome the computational hardness of the A-D 
payoffs: 

lim^oo nj(-) = where ng(.) = i^(-) (4) 

which is the asymptotic operational cost per peer in the system with a large number of peers. We drop superscript rj from 
notations to denote their limits as rj — > oo. From the assumption 05 (a;) > 0, we have O p (.t) > 0. To avoid trivial cases, we 
also assume Cl p [x) is not constant in the interval x 6 [0, 1] for any p <G Z. We also introduce the payoff of each provider per 

4 On the contrary, the term 'Shapley payoff' was used in (4) to refer to the payoff for the game (N, v, {Z U S, — }) where a proper subset of the peer 
set assists the content distribution. 



6 



user, defined as tp^ := -</J^. We now derive the fluid limit equations of the payoffs which can be obtained as r\ — > oo. The 
proof of the following theorem is given in Appendix FBI 

Theorem 1 (A-D Payoff for Multiple Providers) As 77 tends to 00, the A-D payoffs of providers and peers under an arbitrary 
coalition C = Z U H converge to the following equation: 



%(x) = n p (0) - Escz\ M Jo - ur^-\ s \ (M^\ux) - Mi(ux)) du, for peZ 

£f 0*0 = -Esczlo^a - u)^ s \^(ux)du, for n e H. 



(5) 



Here Mg(x) := min \j2 ie s n i(Vi) I EigsW < W > °} and ^nO*) : = °- Note that m£ } (x) = fl P (x). 

The following corollaries are immediate as special cases of Theorem Q] which we will use in Section [V] 

Corollary 1 (A-D Payoff for Single Provider) As r\ tends to 00, the A-D payoffs of providers and peers who belong to a 

single-provider coalition, i.e., Z = {p}, converge to the following equation: 

f ^\ X ) = n p (o) - f^4 p} (ux)du, (6) 

\ &i p} (x) = - Jg 1 u dM d s > (ux)du, for n £ H. 

Corollary 2 (A-D Payoff for Dual Providers) As 77 tends to 00, the A-D payoffs of providers and peers who belong to a 
dual-provider coalition, i.e., Z = {p,q}, converge to the following equation: 

j $, p ' g} (x) = n p (0) - /J uM^ q} (ux)du - J^(l - u)M^ } (ux)du + J* uM^ ] (ux)du, (p, q are interchangeable) 

I Vn' q} (x) = - Jo u2 dM £" ( ux ) du ~ EiG{p, 9 } Jo u (! - u )^7n^( ux ) du : for n G H. 

(7) 

Note that our A-D payoff formula in Theorem Q] generalizes the formula in Misra et al. J4j Theorem 4.3] {i.e., \Z\ = 1). It 
also establishes the A-D values for distinguished multiple atomic players (the providers) and infinitesimal players (the peers), 
in the context of the Aumann-Shapley (A-S) prices J5] in coalition game theory. 

Our formula for the peers can be interpreted as follows. Take the second line of (O as an example. Recall the definition of 
the Shapley value (HJ. The payoff of peer n is the marginal cost reduction v(SU {n}) — v(S) that is averaged over all equally 
probable arrangements, i.e., the orders of players. It is also implied by (Hi that the expectation of the marginal cost is computed 
under the assumption that the events \S\ = y and \S\ = y' for y ^ y' are equally probable, i.e., P(\S\ = y) = P{\S\ = y'). 
Therefore, in our context of infinite player game in Theorem Q] for every values of ux along the interval [0, x], the subset 
S C ZUH contains ux fraction of the peers. More importantly, the probability that each provider is a member of S is simply 
u because the size of peers in S, rjux, is infinite as rj — > 00 so that the size of S is not affected by whether a provider 
belongs to S or not. Therefore, the marginal cost reduction of each peer on the condition that both providers are contained in 



S becomes — u 2 —9- — (ux). Likewise, the marginal cost reduction of each peer on the condition that only one provider is in 
the coalition is — u(l — u) — — (ux). 

IV. Instability of the Grand Coalition 

In this section, we study the stability of the grand coalition to see if rational players are willing to form the grand coalition, 
only under which they can be paid their respective fair Shapley payoffs. The key message of this section is that the rational 
behavior of the providers makes the Shapley value approach unworkable because the major premise of the Shapley value, the 
grand coalition, is not formed in the multi-provider games. 



{p,q} 



A. Stability of the Grand Coalition 

Guaranteeing the stability of a payoff vector has been an important topic in coalition game theory. For the single-provider 
case, \Z\ = 1, it was shown in JU Theorem 4.2] that, if the cost function is decreasing and concave, the Shapley incentive 
structure lies in the core of the game. What if for \Z\ > 2? Is the grand coalition stable for the multi-provider case? Prior to 
addressing this question, we first define the following: 

Definition 5 (Noncontributing Provider) A provider p e Z is called noncontributing if Mjf(l) — M^ p \l) = Q p (0). 
To understand this better, note that the above expression is equivalent to the following: 

(Eiez&W-MjfU)) - (E ie z\ M ^(0)-M,f {p} (l)) =0 (8) 

which implies that there is no difference in the total cost reduction, irrespective of whether the provider p is in the provider 
set or not. Interestingly, if all cost functions are concave, there exists at least one noncontributing provider. 
Lemma 2 Suppose \Z\ > 2. If f2 p (-) is concave for all p e Z, there exist \Z\ — 1 noncontributing providers. 
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To prove this, recall the definition of Mjf (■): 

Mg(x) =mm yeY ( x) Y, i& z&i(yi) where y(o:) := {(j/x,-" | E iS z ^ < ^ 2fc > °l- 

Since the summation of concave functions is concave and the minimum of a concave function over a convex feasible region 
Y(x) is an extreme point of Y(x) as shown in |[T3l Theorem 3.4.7], we can see that the solutions of the above minimization 
are the extreme points of {(yi, ■ ■ ■ , y\z\) I J2iez Vi — x i Vi — 0}> which in turn imply y.- L = for \Z\ — 1 providers in Z. 
Note that the condition \Z\ > 2 is necessary here. 

We are ready to state the following theorem, a direct consequence of Theorem Q] The proof is given in Appendix [C] 
Theorem 2 (Shapley Payoff Not in the Core) If there exists a noncontributing provider, the Shapley payoff for the game 
(Z U H, v) does not lie in the core. 

It follows from Lemma [2] that, if all operational cost functions are concave and \Z\ > 2, the Shapley payoff does not lie in 
the core. This result appears to be in best agreement with our usual intuition. If there is a provider who does not contribute 
to the coalition at all in the sense of (0 and is still being paid due to her potential for imaginary contribution assessed by the 
Shapley formula (Q]i, which is not actually exploited in the current coalition, other players may improve their payoff sum by 
expelling the noncontributing provider 

The condition \Z\ > 2 plays an essential role in the theorem. For \Z\ > 2, the concavity of the cost functions leads to the 
Shapley value not lying in the core, whereas, for the case \Z\ = 1, the concavity of the cost function is proven to make the 
Shapley incentive structure lie in the core J4] Theorem 4.2], 

B. Convergence to the Grand Coalition 

The notion of the core lends itself to the stability analysis of the grand coalition on the assumption that the players are 
already in the equilibrium, i.e., the grand coalition. However, Theorem [2] still lets further questions unanswered. In particular, 
for the non-concave cost functions, it is unclear if the Shapley value is not in the core, which is still an open problem. We 
rather argue here that, whether the Shapley value lies in the core or not, the grand coalition is unlikely to occur by showing 
that the grand coalition is not a global attractor under some conditions. 

To study the convergence of a game with coalition structure to the grand coalition, let us recall Definition [3] It is interesting 
that, though the notion of stability was not used in J4), one main argument of this work was that the system with one provider 
would converge to the grand coalition, hinting the importance of the following convergence result with multiple providers. The 
proof of the following theorem is given in Appendix ID! 

Theorem 3 (A-D Payoff Does Not Lead to the Grand Coalition) Suppose \Z\>2 and is not constant in the interval 
y G [0, x] for any peZ where x = \H\/\H\. The followings hold for all p G Z and n G H. 

• The A-D payoff of provider p in coalition {p} U H is larger than that in all coalition T U H for {p} C T C Z. 

• The A-D payoff of peer n in coalition {p} U H is smaller than that in all coalition T U H for {p} C.TCZ. 

In plain words, a provider, who is in cooperation with a peer set, will receive the highest dividend when she cooperates 
only with the peers excluding other providers whereas each peer wants to cooperate with as many as possible providers. It is 
surprising that, for the multiple provider case, i.e., \Z\ > 2, each provider benefits from forming a single-provider coalition 
whether the cost function is concave or not. There is no positive incentives for providers to cooperate with each other under 
the implementation of A-D payoffs. On the contrary, a peer always looses by leaving the grand coalition. 

Upon the condition that each provider begins with a single-provider coalition with a sufficiently large number of peers, 
one cannot reach the grand coalition because some single-provider coalitions are already stable in the sense of the stability 
in Definition [3] That is, the grand coalition is not the global attractor. For instance, take V = {{p} U H, ■ ■ ■ } as the current 
coalition structure where all peers are possessed by the provider p. Then it follows from Theorem [3] that players cannot make 
any transition from V to {<& U H, ■ ■ ■ } where $ C Z is any superset of {p} because provider p will not agree to do so. 

V. A Critique of the A-D Payoff for Separate Providers 

The discussion so far has focused on the stability of the grand coalition. The result in Theorem [2] suggests that if there is a 
noncontributing (free-riding) provider, which is true even for concave cost functions for multiple providers, the grand coalition 
will not be formed. The situation is aggravated by Theorem [3] stating that single-provider coalitions (i.e., the separated case) 
will persist if providers are rational. We now illustrate the weak points of the A-D payoff under the single-provider coalitions 
with a few representative examples. 

A. Unfairness and Monopoly 

Example 1 (Unfairness) Suppose that there are two providers, i.e., Z = {p, q}, with Q p (x) = 7(x — l) 15 /8 + 1/8 and 
£lq(x) = 1 — x, both of which are decreasing and convex. All values are shown in Fig. [3] as functions of x. In line with 
Theorem [3] providers are paid more than their Shapley values, whereas peers are paid less than theirs. 
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Cost Functions 



A-D Payoffs of Providers 



A-D Payoff of Each Peer 



0.2 0.4 0.6 0.8 



■ Provider p Provider q | 



Shapley Value 




0.2 0.4 0.6 0.8 



■ Provider p (Separated) Provider q (Separated) 

Provider/? (Coalescent) — - — Provider q (Coalescent) 



■ Peers with p Peers with q 

Peers with hoth p and q 



Fig. 3. Example A-D Payoffs of Two Providers and Peers for Convex Cost Functions. 



Cost Functions 



A-D Payoffs of Providers 



A-D Payoff of Each Peer 




0.2 0.4 0.6 0.8 

| — Provider/? Provider q \ 



■ Provider p (Separated) Provider q (Separated) 

Provider p (Coalescent) — ■ — Provider (/(Coalescent) 



Shapley Value 

... -5 




■ Peers with p Peers with q 

Peers with both p and q 



Fig. 4. Example |2] A-D Payoffs of Two Providers and Peers for Concave Cost Functions. 



We can see that each peer n will be paid 21/32 (ip^(0)) when he is contained by the coalition {p, n} and the payoff 
decreases with the number of peers in this coalition. On the other hand, provider p wants to be assisted by as many peers as 
possible because tp^ (x) is increasing in x. If it is possible for n to prevent other peers from joining the coalition, he can 
get 21/32. However, it is more likely in real systems that no peer can kick out other peers, as discussed in |4] Section 5.1] 
as well. Thus, p will be assisted by x 
will be assisted by 1 — x = 0.3837 fraction of peers 



0.6163 fraction of peers, which is the unique solution of tpn (x) = (pn {%) while q 



Example 2 (Monopoly) Consider a two-provider system Z = {p, q} with fl p (x) = 1 — .t 3 / 2 and & q (x) = 1 — 2x/3, both of 
which are decreasing and concave. All values including the Shapley values are shown in Fig. |4] Not to mention unfairness in 
line with Example Q] and Theorem [3] provider p monopolizes the whole peer-assisted services. No provider has an incentive to 
cooperate with other provider. It can be seen that all peers will assist provider p because tp^ (x) > pffi (x) for x > 25/81. 
Appealing to Definition [3] if the providers are initially separated, the coalition structure will converge to the service monopoly 
by p. In line with Lemma [2] and Theorem |2j even if the grand coalition is supposed to be the initial condition, it is not stable 
in the sense of the core. The noncontributing provider (Definition [5]) in this example is q. 



B. Instability of A-D Payoff Mechanism 

The last example illustrates the A-D payoff can even induce an analog of the limit cycle in nonlinear control theory. 

Example 3 (Oscillation) Consider a game with two providers and two peers where N = {px,P2, fix, n 2 }- If {tii}, {"2} and 
{711,712} assist the content distribution of px, the reduction of the distribution cost is respectively 10$, 9$ and 11$ per month. 
However, the hard disk maintenance cost incurred from a peer is 5$. In the meantime, if {rii}, {712} and {n 1 ,n 2 } assist the 
content distribution of p 2 , the reduction of the distribution cost is respectively 6$, 3$ and 13$ per month. In this case, the hard 
disk maintenance cost incurred from a peer is supposed to be 2$ due to smaller contents of p 2 as opposed to those of px- We 
refer to Appendix [E] for a detailed analysis. 
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Fig. 5. Example [3] A-D Payoff Mechanism Leads to Oscillatory Coalition Structure. 

Table U contains A-D payoffs (and Shapley payoffs for the grand coalition) and blocking coalitions C C N for any coalition 
structure where, for notational simplicity, we adopt a simplified expression for coalitional structure V: a coalition {a, b,c} G V 
is denoted by abc and each singleton set {i} is denoted by i. We first observe that the Shapley payoff of this example does 
not lie in the core. 

As time tends to infinity, the A-D payoff exhibits an oscillation of the partition V consisting of the four recurrent coalition 
structures as shown in Fig. [5] As of now, from the-state-of-the-art in the literature on this behavior ifTTI . it is not yet clear how 
this behavior will be developed in large-scale systems. 

VI. Concluding Remarks 

A quote from an interview of BBC iPlayer with CNET UK 1141 : "Some people didn't like their upload bandwidth being 
used. It was clearly a concern for us, and we want to make sure that everyone is happy, unequivocally, using iPlayer." 

In this paper, we have studied whether the Shapley incentive structure in peer-assisted services would be in conflict with 
the pursuit of profits by rational content providers and peers. A lesson from our analysis is summarized as: even though it is 
righteous to pay peers more because they become relatively more useful as the number of peer-assisted services increases, the 
content providers will not admit that peers should receive their due deserts. The providers tend to persist in single-provider 
coalitions. In the sense of the classical stability notion, called 'core', the cooperation would have been broken even if we had 
begun with the grand coalition as the initial condition. Secondly, we have illustrated yet another problems when we use the 
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Shapley-like incentive for the exclusive single-provider coalitions. These results suggest that the profit-sharing system, Shapley 
value, and hence its fairness axioms, are not compatible with the selfishness of the content providers. 
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Appendix 

A. An Intelligent Coalition for Non-Decreasing Worth Functions 

It is reasonable to assume that, if the assistance from some peers increases the operational cost, they should not be allowed 
to assist the content distribution. In light of this, the worth of S can be defined as a maximum of v(S): 

v(S) := fi^O) - mino< v <x fi£(y). (9) 

There is a subtle difference between (f2]i and ((9). Informally speaking, not all players within a coalition will remain passively 
when some outside peers are to decrease the worth of the coalition. Therefore, in games with worth function (0, peers who 
could have resulted in the decrease of the worth are not even eligible for membership of S. One can easily show that the core 
of game (S, v), where S P\ Z = {p} and \3 D H \/r) = x, is nonempty by using the Bondareva-Shapley Theorem iflOl Theorem 
3.1.4]. 



B. Proof of Theorem Q] 

We use notation tp z (x) to denote <p(Z U H, v). We use the mathematical induction to prove this theorem. The equation © 
holds for \Z\ = and Z = (empty set) because we have from (© that there is no provider to pay and 0^{x) = for n G H. 

Now we assume that © holds for all 3 C Z such that |H| < £ where £ > 0. To prove Theorem [1] it suffices to show that 
(O also holds for all H'CZ such that |H'| = £ + 1. To this end, we first apply Axiom CE. As 77 tends to infinity while x 
remains unchanged, for p£S' and n G H, Axiom CE for the partition {2' U H} can be rewritten as follows: 

£ ${x)+x${x) = £ n p (o)-ME'(x) do) 

pes' psh' 

which is the normalized (which we did in (HJi) total coalition worth created by the coalition 2' U H. Another axiom we apply 
is Axiom FAIR (fairness) which was used by Myerson |fT31 to characterize the Shapley value. It follows from FAIR that 

tp*'(x)-0Z'\W(x) = ±vf(x), for all pG 2'. (11) 
Summing up these equation for p G 2' and dividing the sum by |2'| = £ + 1, we obtain 

^(*) = 7TT E (Vr vw (*) + = 7TT E ^ w («) + E *f (*) < 12 > 

pes' ^ / pes 1 pgH' 

by plugging which into ( [Tol l, we obtain 

(£+ 1) E *f (*) + ^ E $f (*) = (£ + !) E ^(°) - Wo M - x E £n' XW v*)- (13) 

pgH' pGH' peH' p£H' 
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Since we know the form of <fn ^ p \x) for all p <E 3' from the assumption (y |S' \ {p}\ = £), ([T3l is an ordinary differential 
equation of unknown function J2 P e~' $p Denote the RHS of (|T3T > by G(x). Appealing to J4] Lemma 3], we get 



V ^f(x) = / u«G(w.T)du = V O p (0) - / + l)Mg'(W)du - / ii C+1 a; V ^f\ {p} (ua;)dw, 

pG E' p G E' ^ ^ pGE' 

d;c ^ ^° dx ^° P t^- ^° p^ dx 

= -(e + i)/ ^ +l ^-(ux)d U + (e + i) / u f+l y ^'\ {p} ( ua; )d u - y (is) 

Jo Jq 

pG = pG=' 

where the last expression follows by integrating the last term of ( TT4| ) by parts. From dT2b and ( fTBT ). <J5^ (.t) is rearranged as 

Vn (») = -/ r°-(wx)du+ / V ^ Up} (wx)du. (16) 

Jo dx Jo peH , 

~' \ r -i 

From the assumption, ip„ (a;) is given by (0 for Z = 3' \ {p}, which is plugged into the last term of ( TToT l to yield 

/ y ^\ {p} (ux)du = - y y / / {ut)^(u- u tf-^^-^{utx)udtd U . (id 

J ° PGH' pGH' 5CE'\{p} ^ ^ 

In the meantime, we need the following identity to reduce the double integral of (1171) : 

pi pi pi pU pi pi 

/ / (uty sl (u-utf-^f(utx)udtdu= / / T |s| (u-r)«- |s| /(ra;)dTdu= / / r |s| (u - r)^ |5| /(rx)dMdr 
Jo Jo Jo Jo JO Jt 

^f^^^^'a-rp 1 - 151 /^ (18) 

where we used the change of variable ut = t and changed the order of the double integration with respect to u and r. Plugging 
dT8l into (Qj]) yields 



/ 1 «« +1 E^ xw (««)d« = -E E j-fro/ 1 



dx 



pes' pes' sc3'\{p} 

y f u \s\{i- u f+^-\s\^MK {ux)du , (19) 



where the last equality holds because 



E E /(^) : E /(-s) = «+!)■ h PI =e+i-i5|:i. 

peH'scH'\{p} sce'.s^e' W V 1*1 

Plugging ( fT9l ) into ( TToT l establishes the following desired result: 



^f(x) =-Y C - «) f+1 " |S| ^Wd« 



sc 

from which follows 

^(x)-^'\W(x) = -y; / 1 u i s i(i- U )«+ i -i s i d ^( U x)d U + y /V'a-uje-w^ciuOdu. 

sch'^o dT sch'Vp} 70 dx 

Since the first term of the RHS can be decomposed into the following: 

sum ,i dM s 



r 1 dM su{Pi r 1 

y / u isi+i (1 _^+i-(isi+i)d^ — (ux)d U - y / u |5| (i 



u) ?+l-|5|^0 (ra)dU) 

da: 



SCH'\{p}-' u SCH'\{p}' 

we can obtain 

^'(a=)-^' Uj,} W = - E ^^ |S|+ \l~^- |S| (^^(^)-^(^)]d^ 



(21) 



SCH'\{p} 
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Integrating ( fTTT i from to a; with respect to x and from ( |2T1 ). we get 



SCE'\{p} J ° 



M^ {p} (ux)-Mi(ux) 



\ 



M^ {p} (0)-Mi(0) 



\ 



\ 



n p (o) 



/ 



n p (o) - E / M ' s '( 1 ~ ( M n u{p} ( w - T ) - M n («*)) du 



SCH'\{p}' 

which finally establishes that (0 also holds for all H'CZ such that |S'| = £ + 1, hence completing the proof. 
C. Proof of Theorem [2] 

To prove the theorem, we need to show that the condition for the core in Definition Q] is violated, implying that it suffices 
to show the following: 



n 



,(0)-(M|(l)-M^ W (l) 



(22) 



This means that the payoff of p G Z is greater than the marginal increase of the limit worth, i.e., 

lim -v(ZUH)- lim -v((Z \ {p}) U H). 
Subtracting the RHS of d22t from the LHS of d22t and using the expression of ^ (1) in ©, we have 

m£(1) m™(i) - E T - -) |zhlHS| (<**(«) - M£(uj) du. 

We can see from Definition [5] that Mjf (1) — Af£^^(l) = f2 p (0). From the assumption, there exists a noncontributing provider 
which we denote by p. To show that d23l is strictly positive, we rewrite the last factor of the integrand as follows: 



(23) 



M. 



su{ P } 



(y) - Mi (y) = min J £ f* 4 (y 4 ) | £ ^ 2/' »* - f ~ min i E I E »< - y ' ^ - f 

[ieSu{p} ;esu{p} J lies ies J 



where the first term in the RHS can be rearranged as 



min< e &i(yi) \ E y* - y ' yi - r - ^p(°) + mm s E^^ y ^l E y * - y > Vi - \ 

[iesu{ P } iesu{p} J Ues ies ) 

where the inequality holds from that Vli(y), i 6 Z, are non-increasing. It can be easily seen that the inequality holds by 
considering two cases y p = and y p > 0. The inequality becomes strict when 5 = over some interval in [0, x] whose length 
is positive due to the assumption that O p (y) is not constant in the interval y 6 [0,.t] and non-increasing. From this, we can 
see that d23l is greater than 

ryo)- E / u |s| (i-u) | ^ | - 1 - |s| o p (o)du = o 

SCZ\{p} Ja 

which establishes J22l . hence completing the proof. 
D. Proof of Theorem \3\ 

To prove Theorem [3] it suffices to show that the following holds for {p} C T such that T C Z: 

V { p p} (x) - ^T(x) = E / " I5 '(l - u) |TMHS| (il/^ uM (wx) - Ma(wx)) du- [ A'4 p] {ux)du > (24) 
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which implies that the payoff of p when it is the only provider of the coalition is larger than that with other providers T\ {p}. 
To this end, we first observe that, for y < x, 



(</) - Mg(y) = min i ^ £li(yi) | Vi - v ' Vi - f _min 1 Y2^ Vi ^ I ^2 Vi - y ' Vi - f 

[iesu{p} «esu{p} J UeS ies J 



Here the first term in the RHS can be rearranged as 



min J ^ fiidfe) | ^ tfi < y, Vi > I > M^(y) + min J ^ CUfa) \ J^Vi < V,Vi > | 

where the inequality holds from that M^\y), i £ T, are non-increasing. It can be easily seen that the inequality holds by 
considering two cases y p = and y p > 0. The inequality becomes strict when 5 = over some interval in [0, x] whose length 
is positive due to the assumption that £lp(y) is not constant in the interval y € [0,x] and non-increasing. From this inequality, 
we have M^ u ^ (y) — M^{y) > Mq (y) and the inequality is strict over some interval of positive length. Plugging this 
relation into d24l yields 



\SCT\{p} J ° 



u^(l - u)l r l- 1 -l s lM^' } (tia!)d« ] - I"' M^ } (ux)du > 0. 

In the meantime, we can see the following from (TTOb : 

lim v({p} UH)/r] = 0,(0) - Mi p} (x) < V 0(0) - Mn(i) = lim u(T U H)/r) 

which, when combined with (x) > ifp(x), implies the second part of the theorem. 



£. Computation of the A-D Payoff in Example \3\ 

From the description of the cost reduction and the hard disk maintenance cost incurred from peers, we can compute the net 
cost reduction for all possible coalitions. For example, if m and n 2 help p\, the coalition worth becomes v({ni, n 2 ,pi}) = 
11$ — 5$ — 5$ = 1$. In a similar way, we have the following result: 



0, 


if S is 


not profitable, 


5, 


if 5 = 


{Pi,n>i}, 




if 5 = 


{Pi,n 2 }, 


1. 


if 5 = 


{p 1 ,n 1 ,n 2 }, 


4, 


if 5 = 


{P2,"l}, 


1. 


if 5 = 


{P2,n 2 }, 


9, 


if 5 = 


{p 2 ,ni,n 2 }. 



Using the same expression (01 as in Section [III] it is easy to see that the coalition worths for coalescent provider cases are 
v({pi,p 2 , ni}) = 5, v({pi,p 2 , n 2 }) = 4 and v({pi,p 2 , ni,n 2 }) = 9. 

Suppose that peers continue to form a new coalition C" when they can improve away from the current coalition C. That is, 
if there is a blocking coalition C' (Definition [3j, they will betray C. It is easy to see that almost all coalition structures are 
transient. Note that, as discussed in (6), one can get two types of resulting coalition structures when a player departs from a 
coalition. For example, if player n\ departs from her coalition in {pinin 2 ,p 2 } to form a coalition with p 2 , we may get either 
{pi, n 2 ,p 2 ni} or {pin 2 ,p 2 ni}. To obtain Table [J we assumed only the latter case to simplify the exposition. 



